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(54) Digital process sensitivity correction 

(57) A method for producing photographic images 
from a photographic film strip (1 0), of the type that uses 
density values of the photographic film strip to deter- 
mine the density values of the produced photographic 
images, comprising the steps of: 

a) forming at least two reference patches (1 4) of dif- 
fering exposure conditions onto an otherwise unex- 
posed portion of the photographic film strip prior to 
photographic processing, each reference patch fall- 
ing within the total scale of the photographic film 
strip; 

b) photographically processing the photographic 
film strip to form densities corresponding to the 
photographic images and said reference patches; 

c) scanning said processed photographic film strip 
to form density representative digital signals for the 
photographic images (12) and said reference 
patches (14); 

d) obtaining standard film density values represent- 
ative of the photographic film strip; 

e) calculating gamma correction values from said 
density representative digital signals corresponding 
to said reference patches and said standard film 
density values; 

f) utilizing said calculated gamma correction values 
and said density representative digital signals cor- 
responding to the photographic images to form cor- 
rected density representative digital signals; and 

g) utilizing said corrected density representative 
digital signals to produce photographic images from 
the images recorded on the photographic film strip. 
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Description 

FIELD OF THE INVENTION 

The invention relates generally to the field of photography, and in particular to silver halide photography. 
BACKGROUND OF THE INVENTION 

A photographic system is composed of several stages, which together function to record and generate a reproduc- 
tion of an original scene. A pleasing reproduction requires a specific relatbnship between the luminance of the scene, 
and the density of the reproduced image. Conventional photographic systems are designed such that the characteristic 
responses of all stages taken together produce the desired relationship between the original scene recorded and the 
reproduced image. Each stage in the photographic system is subject to variations in its response characteristics which 
will alter the sought relationship between the original scene and the reproduced image. In each of the classical forms 
of photography noted below, the final image is intended to be viewed by the human eye. Thus, the conformance of the 
viewed image to the recorded scene, absent intended aesthetic departures, is the criterion of photographic success. 

In classical black-and-white photography, a photographic element containing a silver halide emulsion layer coated 
on a transparent film support, commonly referred to as a photographic film, is imagewise exposed to light This pro- 
duces a latent image within the emulsion layer. The film is then photographically processed to transform the latent 
image into a silver image that is a negative image of the subject photographed. The resulting processed photographic 
film, commonly referred to as a negative, is placed between a uniform exposure light source and a second photographic 
element, commonly referred to as a photographic paper, containing a silver halide emulsion layer coated on a white 
paper support. Exposure of the emulsion layer of the photographic paper through the negative produces a latent image 
in the photographic paper that is a positive image of the subject originally photographed. Photographic processing of 
the photographic paper produces a positive silver image. The image bearing photographic paper is commonly referred 
to as a print. 

In classical color photography the photographic film contains three superimposed silver halide emulsion layer units, 
one for forming a latent image corresponding to blue (B) light (i.e., Blue) exposure, one for forming a latent image cor- 
responding to green (G) exposure and one for forming a latent image corresponding to red (R) exposure. During pho- 
tographic processing, complementary subtractive primary dye images are formed - that is, yellow, magenta and cyan 
dye images are formed in the blue, green and red recording emulsion layers, respectively. This produces negative dye 
images (i.e.. blue, green and red subject features appear yellow, magenta and cyan, respectively). Exposure of color 
paper through the color negative followed by photographic processing produces a positive color print. 

In one common variation of classical color photography reversal processing is undertaken to produce a positive dye 
image in the color photographic film (commonly referred to as a slide), the image typically being viewed by projection. 
In another common variation, referred to as color image transfer or instant photography, image dyes are transferred to 
a receiver for viewing. When positive photographic film images are formed, second generation slides or prints are made 
by exposing a color photographic material through the color film and reversal processing to form a positive reproduction 
of the original scene. 

The response characteristics of a photographic system are carefully selected to produce a final image that gives a 
pleasing reproduction of the recorded scene. The ability of the photographic system to deliver the desired final repro- 
duction is dependent on the photographic response of each step in the imaging chain conforming to its intended 
response. The response characteristics of the photographic system are intentionally chosen to be different depending 
on the means of viewing the final image. For example, the response characteristics of a photographic system designed 
to produce a print intended for viewing by reflected light are different than those for a system which produces a trans- 
parency image intended for viewing by projection in a darkened surround. Furthermore, the response characteristics of 
a photographic system may be intentionally altered to produce a final image which is an aesthetic departure from a 
faithful reproduction of the original scene. 

The characteristics of an imaging system can be altered by selecting photographic materials which differ in their 
response characteristics or by altering the conditions used to photographically process the photographic medium. The 
ability to alter the contrast of the photographic image produced is limited by the choice of photographic print materials 
and processes available. In black and white imaging systems it is typical to alter the contrast of the final print made from 
a negative by selecting photographic papers of different contrasts. Available color photographic papers span a very lim- 
ited range of contrasts, restricting the photographer's ability to alter the contrast of the final image, with conventional 
photographic systems. 

The color balance of the final print produced by a color photographic imaging system can be altered by adjusting 
the color of the light source used when exposing the color negative onto the color paper. However, altering the color of 
the printing light source produces a constant color change throughout the image, equivalent to altering the density of 
the individual color records of the negative by adding or subtracting a constant amount of density. When differences in 
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contrast exist between the color records of a color negative, the amounts of density change required to produce an 
image of high quality is dependent on the image densities. Altering the color of the printing light source is not capable 
of accomplishing the required correction. The inability to correct for differences in contrast between color records results 
in degradation of the final image produced. 
s The response of the photographic film is subject to many sources of variation. Sources of variation include manu- 

facturing, length of time and conditions of storage of the photographic film, and photographic processing. Modern film 
manufacturing methods minimize variations in the freshly manufactured photographic film's ability to record latent 
images upon exposure to light from an original scene. However, the ability of a photographic film to form a latent image, 
and the stability of the latent image formed are both subject to variation dependent on the amount of storage time and 
w the conditions of storage. Raw stock keeping (RSK) of a photographic film relates to variations in the photographic film 
response characteristics dependent on the storage time and conditions prior to exposure of the photographic film to 
light from the original scene. Latent image keeping (LIK) of a photographic film relates to the stability of the latent image 
formed during exposure, prior to its photographic processing. Both aspects of photographic film storage stability are 
subject to significant variations due to the large range of potential storage times and storage conditions routinely 
is encountered in practice. Photographic film response characteristics are also strongly dependent on the conditions of 
photographic processing. Variations in photographic processing which affect the conversion of latent image to image- 
wise density arise from variations in the chemical composition, agitation, and temperature of the processing solutions. 

All of the effects discussed above, as well as other effects not specifically mentioned, alter the amount of density 
formed for different levels of exposure. The relationship between the amount of density formed and the input exposure 
20 level can be characterized by the rate of density increase with increasing exposure (photographic gamma, y), the 
amount of exposure required to achieve a given density (photographic speed), and the amount of density formed in the 
absence of exposure (D min ). As previously discussed, the photographic response characteristics of each photographic 
material used in forming the final reproduction of the original scene is critical in determining the quality of the final 
image. Variations in photographic film response propagate through the photographic system influencing the contrast 
25 and color quality of the reproduced image. Process sensitivity is a dominant factor responsible for the variability of pho- 
tographic response affecting the quality of the reproduced image. 

When the processed photographic film is used as an intermediate in the formation of a final image, such as a print, 
variations in the D min and photographic speed of the photographic film can be corrected during conventional printing by 
adjusting the printing times and the color of the printer light source. In practice, adjustments in the printing conditions 
30 are automated by use of a "scene balance algorithm" (SBA). The SBA relies on the measurement of one or more den- 
sities of the processed photographic film and an empirically determined relationship between the measured densities 
and the corrections to be applied to the printing conditions which are most likely to yield an acceptable print. 

Original versions of the SBA were based on the observation that the average of all colors contained in a typical 
recorded scene is a gray of medium lightness. A single density measurement of the entire area of the processed pho- 
35 tographic film was made and the printing times and printer light source color were adjusted to make the average color 
and density of the image match this medium gray. This type of SBA can successfully correct hue shifts arising from the 
scene illuminant (e.g. daylight, tungsten or fluorescent lighting), and sources of variation in photographic film response 
which uniformly change the color of the scene (e.g. photographic speed and Dmin), only when the average scene color 
is a medium gray, as is assumed. When the average density of a photographic film image deviates from an average gray 
40 due to the distribution of colors contained within the original scene, adjusting the printing conditions to produce a 
medium gray will result in unacceptable reproductions of the original scene (termed subject failure). For example, a 
scene containing large areas of water and sky will have an average density that is bluish and should not be printed to 
average a medium gray. In other examples, scenes containing large areas of snow would be printed too dark and sunset 
scenes would be printed too light To improve the performance of printing algorithms in cases where the original scene 
45 does not average to a medium gray, the amount of color correction toward medium gray made in the printing operation 
is adjusted based on the hue of the average density of the photographic film image. For example, if the average photo- 
graphic film density deviates from gray in the direction of yellow-orange, the source of the deviation is likely to be tung- 
sten illumination and complete correction will usually be successful. However, if the deviation from medium gray is in 
the direction of cyan, it is likely that there are large areas of sky or water in the original scene and the printing conditions 
so should not be adjusted to produce a medium gray. For each image, the degree of correction towards neutral is deter- 
mined by the mapping of the amount of adjustment performed based upon the average hue of the image, referred to as 
the subject failure suppression boundary. 

Another method of determining the amount of correction required in the printing operation is to scan all of the 
images on a strip of photographically processed film and evaluate the deviations from medium gray of all recorded 
55 images. Based on assumptions about the relationships between recorded images, adjustments in the amount of cor- 
rection toward medium gray of the printing conditions are made. When averaged over an entire sequence of images, 
hue and density changes due to processing will be constant, but those arising from scene composition will tend to aver- 
age to medium gray. 

More sophisticated algorithms attempt to identify the subject recorded on the photographic film in order to discrim- 
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inate between hue shifts that require color correction and those that do not. Subject recognition requires multiple den- 
sity measurements of each photographic film image to determine the location, area, and color of objects in the recorded 
scene. Recognition of scene content can then be used to determine the amount of correction toward medium gray 
required when printing the photographic film image. 

5 In all cases, SBA's are used to improve the quality of the reproduced images, without the cost associated with cus- 

tom printing each image recorded on the photographic film. Furthermore, the operation of every SBA is dependent on 
an evaluation of the hue of the image contained in the processed photographic film. Unexpected deviations in the 
response characteristics of the processed photographic film from any of the sources discussed above will affect the 
ability of a SBA to correctly adjust the printing conditions, degrading the quality of the final image reproduction. In some 

io cases, the parameters of the SBA are adjusted to compensate for variations in the photographic response due to vari- 
ations in photographic processing conditions characteristic of a single photofinishing operation. This adjustment will 
typically be incorrect for any single strip of photographic film since the SBA adjustments are determined for the average 
response of many photographic film strips. 

The performance of an automated photographic printer can be further improved by objectively characterizing the 

is photographic response of each individual strip of photographic film. Characterizing the photographic response of each 
strip of photographic film eliminates the need to adjust the operation of the SBA based on the average properties of all 
photographic films being handled. Variations in photographic response due to both storage conditions and deviations 
in photographic processing conditions can be objectively corrected if the photographic response for the photographic 
film in use is characterized. 

20 R. Davis, U.S. Patent No. 3,718,074, describes a method of placing reference patches on the photographic film in 
the camera at the time of exposure of each scene. T Terashita et al, U.S. Patent No. 4,577,961, describe a similar 
method in which the reference patches are applied to the photographic film immediately prior to photographic process- 
ing. In both disclosures the densities of the reference patches are measured following photographic processing and the 
information obtained is used to adjust the operation of the SBA and improve the selection of printing conditions for a 

25 conventional optical printing device. 

Both of the methods described above are capable of detecting deviations in the response characteristics of the 
photographic film due to variations in manufacturing, storage, and photographic processing. Recognition of variations 
in photographic film response is used to improve the performance of SBA's and to more reliably adjust the printing con- 
ditions to compensate for variations in image hue due to constant changes in density throughout the photographic film 

30 image. Constant changes in image density occur when the Dmin or speed of a photographic film is altered. However, 
in addition to changes in D min and speed, variations in film manufacturing, storage, or photographic processing affect 
film gamma. Variations in film gamma result in density changes which depend on film density. Adjustment of the aver- 
age density of a printed photographic image, as detailed in the methods described above, is not capable of correcting 
for alterations in photographic film gamma. 

35 With the emergence of computer data processing, interest has developed in extracting the information contained in 
an imagewise exposed photographic film strip instead of proceeding directly to a viewable image. It is now common 
practice to extract the information contained in both black-and-white, and color images, by scanning. The most common 
approach to scanning a black-and-white negative is to record point-by-point or line-by-line the transmission of a scan- 
ning light beam, relying on developed silver to modulate the beam. In color photography blue, green and red scanning 

40 beams are modulated by the yellow, magenta and cyan image dyes. In a variant color scanning approach the blue, 
green and red scanning beams are combined into a single white scanning beam which is modulated by the image dyes, 
and is read through red, green and blue filters to create three separate records. The records produced by image dye 
modulation can then be read into any convenient memory medium (e.g., an optical disk) where the information is free 
of the classical restraints of photographic embodiments. Systematic manipulation (e.g., image reversal, hue alteration, 

45 etc.) of the image information that would be cumbersome or impossible to achieve in a controlled and reversible manner 
in a photographic element is readily achieved. The stored information can be used to modulate light exposures neces- 
sary to recreate the image as a photographic negative, slide, or print. Alternatively, the image can be viewed as a video 
display or printed by a variety of techniques beyond the bounds of classical photography-e.g., xerography, ink jet print- 
ing, dye diffusion printing, etc. 

so I. Shishido et al, U.S. Patent No. 5,060,061 , describe a means for correcting the effect of variations in photographic 
film response characteristics by measuring the density of an unexposed region of the photographic film (D mjn ). The pho- 
tographic image is also scanned to give a digital representation of the image densities. Comparison of the measured 
D min with the predetermined D mjn characteristics of the film type are used to select a predetermined look-up-table 
(LUT), which is used to modify a digital representation of the image densities, in order to adjust the tone of the image. 

55 This approach is limited in that alterations in the tone scale are made based on the characteristics of photographic film 
D min only. Variations in photographic speed and gamma of a photographic film can occur without concomitant changes 
in the D min . Using the approach of Shishido, deviations in photographic speed and gamma would go undetected and 
uncorrected in the printing operation. Furthermore, the range of variations which can be corrected is limited to those 
that have been predetermined. Variations not anticipated will remain uncorrected. 
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SUMMARY OF THE INVENTION 

The present invention is directed to overcoming one or more of the problems set forth above. Briefly summarized, 
according to one aspect of the present invention there is provided a method for producing photographic images from a 
5 photographic film strip, of the type that uses density values of the photographic film strip to determine the density values 
of the produced photographic images, the improvement comprising the steps of: 

a) forming at least two reference patches of differing exposure conditions onto an otherwise unexposed portion of 
the photographic film strip prior to photographic processing, each reference patch falling within the total scale of the 

io photographic film strip; 

b) photographically processing the photographic film strip to form densities corresponding to the photographic 
images and said reference patches; 

75 c) scanning said processed photographic film strip to form density representative digital signals for the photo- 
graphic images and said reference patches; 

d) obtaining standard film density values representative of the photographic film strip; 

20 e) calculating gamma correction values from said density representative digital signals corresponding to said refer- 
ence patches and said standard film density values; 

f) utilizing said calculated gamma correction values and said density representative digital signals corresponding 
to the photographic images to form corrected density representative digital signals; and 

25 

g) utilizing said corrected density representative digital signals to produce photographic images from the images 
recorded on the photographic film strip. 

It is thus an object of the present invention to provide a method of correcting for unwanted variations in photo- 
30 graphic film response, when the photographic film image is scanned and digitally printed or displayed, which overcomes 
the limitations of the prior art. 

The invention improves over the art in that it can yield useful quality improvements in reproduced images when var- 
iations in photographic film response occur which affect film gamma. 

The above and other objects of the present invention will become more apparent when taken in conjunction with 
35 the following description and drawings wherein identical reference numerals have been used, where possible, to desig- 
nate identical elements that are common to the figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 Fig. 1 illustrates in block diagram form the preferred system arrangement of the present invention; 
Fig. 2 illustrates in a detailed block diagram form the details of one of the major blocks of Fig. 1 ; 
Fig. 3 illustrates in detail the further image processing block of Fig. 2; 

45 

Fig. 4 is a plot illustrating the D Log E response of the film to reference exposures; 

Fig. 5 illustrates in detail the further image processing block of Fig. 2; and 

so Fig. 6 illustrates in detail the further image processing block of Fig. 2. 

DETAILED DESCRIPTION OF THE INVENTION 

The invention is equally applicable to black-and-white and color recording photographic films. Furthermore, the 
55 invention is equally applicable to both positive and negative working photographic films. Unless otherwise indicated, the 
following discussion will relate to negative working, color recording photographic films. 

This invention describes the determination of correction values which are subsequently used to transform digital 
signals representative of the photographic image. The term "correction value" in this application is taken to refer to a 
broad range of mathematical operations which include, but are not limited to, mathematical constants, matrices, linear 
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and non-linear mathematical relationships, and look-up-tables (LUTs). 

In the simplest form, characterization of photographic film gamma requires the use of two reference patches with 
exposure levels which, exceed the minimum exposure required to produce a density above the minimum density formed 
in the absence of exposure (Dmin), and are less than the exposure at which further increase bin exposure no longer 

5 results in increased density (D max ), following photographic processing. This exposure range is commonly referred to as 
the total scale of the photographic film, as discussed in JAMES THE THEORY OF THE PHOTOGRAPHIC PROCESS, 
PAGE 501 , 502 (4TH ED. 1977, EASTMAN KODAK COMPANY). The portion of the total scale that produces a linear 
density response verses log exposure is referred to as the linear exposure scale. Preferably the reference patch expo- 
sures are neutral. Referring to Fig. 1 , a photographic film strip 1 0 has image areas 1 2 exposed to a scene by means of 

w camera 20. Reference patches 1 4 are exposed onto the photographic film strip 1 0 by the sensitometer 30. The sensit- 
ometer 30 may be positioned in the camera 20 to place the reference patches 14 onto the photographic film strip 10 
either prior to or after the placement of images 1 2. In another preferred embodiment, the reference patches are placed 
onto the photographic film at the time of manufacture. A third preferred embodiment would place the reference patches 
onto the photographic film following removal from the camera, prior to photographic processing. The reference patches 

is 14 may be placed at any region of the photographic film strip 1 0 that will not otherwise be exposed, such as the portion 
of the photographic film strip that does not come out of the film cartridge or the edge of the photographic film that is not 
within the image frame. In a preferred form of the invention, the specified region of the photographic film strip 10 is 
reserved for recording reference patches. The reference patch exposure levels are chosen to be as different as possible 
while still falling within the total scale, and preferably within the linear response scale, of the photographic film strip 10, 

20 as shown in Fig. 4. 

The photographic film strip 10 is photographically processed in the processor 40 in the well known manner (e.g. 
C41, E6, etc.) following placement of atl photographic images and reference patches onto the photographic film strip. 
The photographically processed film is then scanned by scanner 50 producing density representative digital signals 
which are forwarded to a computer 60 for processing. The processed digital signals are then forwarded to an output 

25 device 70. The output device 70 may take a number of forms such as a silver halide film or paper writer, thermal printer, 
electrophotographic printer, ink jet printer, CRT display. CD disc or other types of storage and display devices. 

Referring now to Fig. 2, the processed photographic film strip 10 that is scanned by the scanner 50. is shown in 
more detail with a number of reference patches 14. The density representative digital signals from the scanner 50 
obtained for reference patches 14 (R Pi , G Pi , B PI ) and for the photographic image 12 (R jp Gj, and Bj) are forwarded to the 

30 computer 60. The density representative digital signals of the reference patches 1 4 are compared with the standard film 
densities (R°», G°i, B°j) which are stored in a table 62 and originate from well manufactured, correctly stored and pho- 
tographically processed film of the same photographic film type as film 10, given exposures which differ in intensity by 
the same amount as those used to obtain the reference patches 14 on the photographic film strip 10. The table 62 is to 
be populated with those standard film densities that correspond to the photographic film types that are to be processed 

35 by this technique. The comparison takes place in block 64. In the simplest form of the invention, only two reference 
patches 14 are used. The differences are used to calculate y correction values according to Eqs. 1-3. 
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In Eqs. 1-3, H and L refer to the high and low density reference patches, respectively, and the superscript "° M refers to 
the values for the standard film densities obtained with "well controlled (manufacturing, storage, and processing) con- 
ditions." 

The gamma correction values are used in the further image processing block 66 of the density representative dig- 
55 ital signals of the image 12 to provide the corrected red. green and blue exposure representative digital signals (E RI , 
E Gi , E Bi ) to the output device 70. The details of processing block 66 are set forth in Fig. 3. 

A typical image processing path is shown in Fig. 3. Density representative digital signals Rj, G i( and Bj from the 
image 12 are processed using a matrix 602. Matrix 602 is represented as follows: 
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In its simplest form, the oft diagonal elements (a4 ag) of MAT Ay are all zero, and the diagonal elements, a 1 -> a 3 , are 
w Ay R ,Ay G , and Aye. respectively, and are calculated using Eqs. 1 -3 for the photographic film strip 10 being processed. As 
shown in Eq. 5, the matrix premultiplies the red, green and blue density representative digital signals of each scanned 
image 12 producing the gamma corrected density representative digital signals (R^ G^, B^). 
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20 Further processing of the gamma corrected density representative digital signals with matrix 604 produces channel 
independent density representative digital signals (Rycio GyciD. B yCiD)- The red « O'een, and blue channel independent 
density representative digital signals are then converted to log exposure representative digital signals by the use of 
three one dimensional LUTs 606. The log exposure representative digital signals for the image 12 are subsampled in 
block 610 at a nominal rate of 1/256th of the full image resolution. A scene balance algorithm 612 is performed on the 

25 subsampled signals producing scene balance shift factors. The shift factors are added to the full resolution log exposure 
representative digital signals in the SBA blocks 614. Three one dimensional LUTs 616 convert the corrected log expo- 
sure representative digital signals to corresponding linear exposure representative digital signals. The linear exposure 
representative digital signals are pre-multiplied by a predetermined matrix (MAT 1) to form a second set of red, green, 
and blue linear exposure representative digital signals. Fig. 5 shows an alternative preferred form of the invention, which 

30 replaces image processing by components 604 through 616 with a single three dimensional LUT 620. 

In another preferred embodiment of the invention, a third reference density measurement is made in a region of the 
photographic film strip 10 which has received no exposure. Density representative digital signals for the unexposed 
region of the photographic film are obtained (R Dmjn , G Dmin , and B Dmin ) from scanner 50. The resulting signals for the 
unexposed region of the photographic film are compared (Fig. 2, block 64) against standard film densities for an unex- 

35 posed region of the photographic film (R 0 Dm in. G°Dmim B° Dm j n ) which are stored in a table 62 and originate from well 
manufactured, correctly stored and photographically processed photographic film of the same film type as film 10. The 
comparison takes place in block 64 where the differences are used to calculate D min correction values according to Eqs. 
6-8. 

40 AR Dmin = AYR*Dmin-*nm t n (6) 



A( 3 Dmin ■ A Y G G Dmin " G ° Dmin (?) 

45 

*B Dn t n = *y B B Dmln -B 0 Dm . n (8) 

The D min correction values are subtracted from the density representative signals of the scanned image in block 603 of 
so Fig. 6. 

A further improvement in performance is obtained if the absolute levels of exposure used to produce the reference 
patches 14 on the photographic film strip 10 are known relative to those used to obtain the standard film densities (R°i, 
G°j. B°i) which are stored in a table 62 and originate from well manufactured, correctly stored and photographically 
processed film of the same film type as film 10. Photographic speed values can be calculated using Eqs. 9-11, 
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R D min"( R L-(p H .p L * E l)) 



H L 



G Dmln -(G L -(f^E L )) 



spd s - g^gT (10) 



Eh-E l 



B Dmin -(B L -(|^|t*E L )) 



(11> 



where E is the log exposure value of the reference patch. 

ASpd R = Spd R -Spd° R (12) 

ASpd q = Spd G - Spd° Q (13) 

ASptf e = Spd B - Spd° (14) 

30 Speed correction values (ASpd) are obtained by comparing the speed values determined for the scanned photographic 
film strip and those obtained from the standard film densities of well manufactured, correctly stored and photographi- 
cally processed photographic film of the same film type as film 10, using Eqs. 12-14. The obtained speed correction val- 
ues are subtracted from the log exposure representative digital signals of the scanned image resulting from LUT 606 in 
block 608 (Fig. 6). The speed corrected image signals improve the performance of the SBA 61 2 by allowing the subject 
: 35 failure suppression boundaries to be adjusted for better differentiation of hue shifts due to the illuminant and those 
resulting from elements in the image, producing superior reproductions of the recorded scene. 

Although the invention can be practiced with as few as two reference patches, other preferred embodiments of the 
invention utilize a larger number of exposure patches of the same or different color. A larger number of reference 
patches, for example, 20 levels, allow a more robust estimation of speed and y correction values, and the ability to cor- 

40 red for more specific changes in the relationship between density produced on the photographically processed film and 
input exposure. 

When more than two reference patches are used, y and speed correction values are obtained by comparing the 
density representative digital signals determined for the references patches and the standard film densities using stand- 
ard methods of regression. When n reference patches are utilized, speed and gamma correction values are chosen for 
45 each record to minimize AR RMS , AG RMS , and AB RMS as defined in Eqs. 1 5-1 7, where the n reference patches fall within 
the total scale of the photographic film. Speed and y correction values obtained in this manner are applied to the 
scanned image signals as described above. Use of more than two reference patches allows a more reliable determina- 
tion of the y correction values appropriate for the total scale of the photographic film and is less sensitive to the place- 
ment of the exposure levels within the total scale. 

50 



55 



^ RMS = -G Dmin -((G r G Dmjn rAy G+ ASpd G *y^) 2 (16) 
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A6„ MS = fc{B°.-B Dmin -({B r B Dmin r*y B+ ASpd B 'yl)) Z (17) 

5 

An alternative and preferred method of applying correction values obtained from many reference patches is to 
replace the three one-dimensional LUTs 606 with the density-log exposure relationships obtained from the reference 
patch data. 

A further affect of variations in photographic film manufacturing, storage, and photographic processing is to alter 
10 the extent of density formation in one image record dependent on the extent of density formation in at least one of the 
remaining image records. A preferred embodiment of the invention involves the use of multiple reference patches, each 
differing from the others in at least one attribute of color and intensity. The density representative digital signals 
obtained from scanning the multiple reference patches are compared with standard film densities which are stored in a 
table 62 and originate from well manufactured, correctly stored and photographically processed film of the same pho- 
75 tographic film type as film 10. The nine elements of matrix 602 (MAT Ay ) are determined by standard methods of regres- 
sion to minimize the differences (AR RMS . Eq- 19) between the signals obtained from the reference patches when 
processed with matrix 602 (Eq. 18) and the standard film densities. 



20 



" R rc," 




-Rf 




=[MAT Ay ] 




- B vc, 







A RMS = |£[K -* Y *) 2 -KG° -G yc/ ) 2 + (^ -e ra ) 2 ] (19) 

Examples 

30 

Replicate strips of three commercially available color negative, camera origination photographic film products were 
obtained, and exposed with 21 levels of neutral reference patches, 64 reference patches of differing color exposures, 
and a variety of scenes. One set of exposures for each photographic film type was photographically processed using 
standard Kodak Flexicolor™ C41 processing (4.5 g/l N-ethyl-N-(p-hydroxyethyI)-3-methyl-p-phenylenediamine sulphate 

35 (CD-4), 1 .3 g/l NaBr. pH 10.03), a second set was processed in a similar fashion with the exception that the developer 
level, bromide ion level and pH level were changed to increase the activity of the process (5.5 g/l CD-4, 0.8 g/l NaBr. pH 
10.13), and a third set of exposed strips was processed in a similar fashion to the first set with the exception that the 
developer level, bromide ion level and pH level were changed to decrease the activity of the process (3.5 g/l CD-4, 1 .8 
g/l NaBr, pH 9.93). These variations in processing conditions are representative of those encountered in the photofin- 

40 ishing industry. Following photographic processing, the photographic images of the recorded scenes and reference 
patches were scanned using an optoelectronic scanning device to yield density representative digital signals. 



Table 1 



55 



Correction values for three selected consumer films 








Ay B 


ASpd R 


ASpdG 


ASpd B 






AB Dmin 


Film 1 Hi Activity 


0.856 


0.932 


0.97 


-.759 


-.246 


-1.66 


-.349 


-1.369 


-.759 


Film 1 Lo Activity 


1.339 


1.159 


1.209 


1.206 


1.827 


2.234 


.035 


.256 


.23 


Film 2 Hi Activity 


0.877 


0.931 


0.905 


.196 


-1.042 


-.297 


-.844 


-.639 


-.475 


Film 2 Lo Activity 


1.166 


1.111 


1.093 


1.045 


2.817 


2.912 


.35 


.141 


.11 


Film 3 Hi Activity 


0.882 


0.909 


0.873 


.358 


-.369 


-2.363 


-1.625 


-1.055 


-.256 


Film 3 Lo Activity 


1.366 


1.275 


1.399 


.196 


1.089 


2.116 


.135 


.111 


-.828 



Equations 1 , 4, 5. and 6, were used to calculate y correction values, D min correction values, and speed correction 
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values, using two reference patches which differed in intensity by 1.0 log exposure units. The lower reference patch 
exposure level was placed at a density of approximately 0.2 above D min for each photographic film type when photo- 
graphically processed under the normal conditions. The y, speed, and D min correction values calculated with the two 
point method for the three films, processed with the high and low activity photographic processing conditions, are 
shown in Table 1 . The complete set of neutral reference exposures was alternately used to calculate y correction values, 
Dmin correction values, and speed correction values, using standard methods of regression. 

The complete set of reference patches was used to determine the nine elements of matrix 602 by standard meth- 
ods of regression. The correction matrices 602 for the three films, processed with the high and low activity photographic 
processing conditions, are shown in Table 2. 

Table 2. 

MAT^y for Photographic Film Processed Under Different 
Conditions, Calculated by Regression Based Upon 
64 Color Exposures 



Color Negative 
Film 1 



Color Negative 
Film 2 



Color Negative 
Film 3 



High Activity 

.836 -.034 .059" 

.064 .753 .113 

.039 -.071 .999_ 

\861 .026 -.018" 

.018 .900 .012 

-.010 .006 .910 

\857 -.006 .031" 

-.049 .942 .017 

.014 -.023 .880 



Low Activity 

1.30 .052 -.018" 

.044 1.267 -.152 

.005 .105 1.093 

1.209 -.021 -.020" 

-.034 1.213 -.068 

.003 -.048 1.137 

1.393 -.054 .031 
.075 1.146 .064 

-.038 -.020 1.461 



The scanned density representative digital signals for the recorded scene were processed according to the image 
processing schemes shown in Fig. 3 or Fig. 6. The resulting exposure representative digital signals were used to drive 
a digital exposing device using silver halide photographic paper to make prints. Sets of reference prints for the three 
films were produced in the same manner, using the density representative digital signals from the strips processed with 
the standard activity process, and processing according to the image processing schemes shown in Fig. 3, excluding 
MAT Ay 602. 

The images were compared in two ways: by comparing the exposure representative digital signals for the images 
following image processing with and without correction according to the invention, and by visually comparing the asso- 
ciated silver halide prints produced. The exposure representative digital signals were compared by calculating the aver- 
age root mean squared difference according to Eq. 20, where the summation is conducted over the i pixels and j color 
records of the image and E N y corresponds to the exposure representative digital signals for the photographic film image 
produced using normal photographic processing conditions and a standard scene balance algorithm, and E C jj corre- 
sponds to exposure representative digital signals for the photographic film image produced using non-standard photo- 
graphic processing conditions, after applying the digital correction values according to the invention. Accordingly, 
photographic films subjected to non-standard photographic processing are fully corrected if the RMS deviation is found 
to be zero following image processing. The larger the value of the RMS deviation, the less successful the correction of 
the image signals and the lower the quality of the resultant photographic reproduction. 
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^ RMS 



i ^ (20) 



f J 



The visual comparison utilized a panel of five observers who compared the prepared photographic prints for overall 
image quality. Excellent correlation was found between the trends observed in comparing the exposure representative 
digital signals, and the ranking of the images for quality by the panel of judges; increased print quality was observed as 
the magnitude of the RMS difference decreased. 

10 Large RMS values were observed for images produced in the high or low activity photographic process and image 
processed without the SBA 612, when compared with images produced in the normal process, indicating a significant 
deviation in the densities due to the non-standard photographic processing conditions. Application of the SBA 612, 
according to the prior art, to the image signals of the high or low activity photographic process reduces the magnitude 
of the RMS values, but the residual error gives an observed degradation of the photographic print. The examples below 

is show that the further image processing according to this invention gives significant improvement in the photographic 
print over that obtained using the prior art. 



Example 1 . Table 3 shows the results obtained for color negative film #2, Photographically processed under the 
high activity chemical process. When the image is processed following Fig. 3, omitting y correction matrix 602, the 
20 scene balance algorithm is seen to substantially correct for the high activity process variations (smaller RMS value 
in Table 3, relative to the RMS value without implementation of the SBA). Inclusion of y correction matrix 602 is 
seen to significantly decrease variation due to the high activity photographic process. This results in significantly 
improved final image quality when y correction is employed, compared with images where only the scene balance 
algorithm is used. 



Table 3 



RMS Difference Between Exposure Representative Image Signals for Photographic Film Pho- 
tographically Processed Under Normal and High Activity Conditions 


Image Processing Conditions 


Color Negative Film #2 


High Activity Chemical Process 




Without SBA 612 


40.85 


With SBA 612 


10.55 


With y Correction 602 (diagonal elements only) and SBA 612 


4.84 



40 

Example 2 . Table 4 shows the results obtained for color negative films #1 , #2 and #3, each photographically proc- 
essed under the high activity chemical process. When image processed including a current scene balance algo- 
rithm, images from all three photographic films are substantially improved for the high activity process (smaller 
RMS values in Table 4, relative to the RMS value without implementation of the SBA). Image processing of the den- 
45 srty representative digital signals according to Fig. 6, including y correction matrix 602 and speed correction block 
608, as well as the scene balance algorithm 612, is seen to significantly decrease variation due to the high activity 
photographic processing, relative to use of the SBA alone, resulting in significantly improved quality of the final 
images. 

50 
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Table 4 



RMS Difference Between Exposure Representative Image Signals for Photographic Film Photographically Proc- 
essed Under Normal and High Activity Conditions 


Image Processing Conditions 


Color Negative Film #1 


Color Negative Film #2 


Color Negative Film #3 


High Activity Chemical Process 








Without SBA612 


58.23 


40.85 


52.51 


With SB A 612 


11.43 


10.55 


14.54 


With y correction 602 (diagonal ele- 
ments only) speed correction 608, 
and SBA612 


10.62 


5.62 


8.84 



Example 3 . Table 5 shows the results obtained for color negative film #3, photographically processed using the low 
so activity chemical process. Image processing of the density representative digital signals, including a current scene 
balance algorithm, substantially improved image quality for the low activity process (smaller RMS values in Table 
5, relative to the RMS value without implementation of the SBA). Image processing of the density representative 
digital signals according to Fig. 6, including y correction matrix 602 and speed correction block 608, as well as the 
scene balance algorithm 612, is seen to significantly decrease variation due to the low activity photographic 
25 processing, relative to use of the SBA alone, resulting in significantly improved quality of the final images. 



Table 5 



RMS Difference Between Exposure Representative Image Signals for Photographic Film Photographically Processed 

Under Normal and Low Activity Conditions. 


Image Processing Conditions 


Color Negative Film #3 


Low Activity Chemical Process 




Without SBA 612 


37.85 


With SBA 612 


15.38 


With y Correction 602 (diagonal elements only), speed correction 608, and SBA 612 


9.48 



40 

Example 4 . The gamma correction values, speed correction values and D m j n correction values were recalculated 
using standard regression techniques. Density representative digital signals for examples 2 and 3, for photographic 
films photographically processed in the high and low activity processes, were image processed according to Fig. 6, 
45 including y correction matrix 602 and speed correction block 608, as well as the scene balance algorithm 612, using 
correction values calculated using regression rather than the values in Table 1 . The RMS values obtained are sub- 
stantially the same as those shown in Tables 4 and 5. Again the image processing described in Fig 6. is seen to 
significantly decrease variation due to both the high and low activity photographic processing, relative to use of the 
SBA alone, resulting in significantly improved quality of the final images. 

50 

Example 5. Table 6 shows the results obtained for color negative fBms #1 , #2, and #3, photographically processed 
using the high activity chemical process. RMS values are shown for images from the three films in which density 
representative digital signals were image processed including a current scene balance algorithm, and in which the 
same images are image processed according to Fig. 6, including y correction matrix 602 and speed correction 
55 block 608, as well as the scene balance algorithm 612, reproducing Table 4. For the final entry in Table 6. the den- 
sity representative digital signals from the same images are image processed according to Fig. 6, including y cor- 
rection matrix 602 using y correction matrices from Table 2 rather than the simple diagonal y correction values from 
Table 1 , speed correction block 608, and scene balance algorithm 612. The y correction matrix is shown to further 
significantly decrease variation caused by the high activity photographic process for film #1 , resulting in significantly 
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improved quality of the final images for this film. 



Table 6 



RMS Difference Between Exposure Representative Image Signals for Photographic Film Photographically Proc- 
essed Under Normal and High Activity Conditions. 


Image Processing Conditions 


Color Negative Film #1 


Color Negative Film #2 


Color Negative Film #3 


High Activity Chemical Process 








Without SBA612 


58.23 


40.85 


52.51 


With SBA612 


11.43 


10.55 


14.54 


With y Correction 602 (diagonal 
elements only),speed correction 
608, and SBA612 


10.62 


5.62 


8.84 


With y Correction 602 (all ele- 
ments), speed correction 608, and 
SBA 612 


8.20 


5.47 


8.15 



25 The invention has been described with reference to certain preferred embodiments. However, it will be appreciated 
that variations and modifications can be effected by a person of ordinary skill in the art without departing from the scope 



of the invention. 


Parts List: 


10 


photographic film strip 


12 


image(s) 


14 


reference patches 


20 


camera 


30 


sensitometer 


40 


processor 


50 


scanner 


60 


computer 


62 


table 


64 


comparison block 


66 


processing block 


70 


output device 


602 


matrix 


603 


block 


604 


matrix 
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606 look up table (LUT) 
608 speed correction blocks 
5 610 subsample block 

612 scene balance algorithm (SBA) 
614 block 

w 

616 look up table (LUT) 
620 look up table (LUT) 
75 Claims 

1 . A method for producing photographic images from a photographic film strip, of the type that uses density values of 
the photographic film strip to determine the density values of the produced photographic images, the improvement 
comprising the steps of: 

20 

a) forming at least two reference patches of differing exposure conditions onto an otherwise unexposed portion 
of the photographic film strip prior to photographic processing, each reference patch falling within the total 
scale of the photographic film strip; 

b) photographically processing the photographic film strip to form densities corresponding to the photographic 
25 images and said reference patches; 

c) scanning said processed photographic f ilm strip to form density representative digital signals for the photo- 
graphic images and said reference patches; 

d) obtaining standard film density values representative of the photographic film strip; 

e) calculating gamma correction values from said density representative digital signals corresponding to said 
30 reference patches and said standard film density values; 

f) utilizing said calculated gamma correction values and said density representative digital signals correspond- 
ing to the photographic images to form corrected density representative digital signals; and 

g) utilizing said corrected density representative digital signals to produce photographic images from the 
images recorded on the photographic film strip. 

35 

2. A method according to Claim 1 wherein said reference patches are formed on the photographic film strip as part of 
the manufacturing operation. 

3. A method according to Claim 1 wherein said reference patches are formed on the photographic film strip at sub- 
40 stantially the same time that each image is exposed onto the film strip. 

4. A method according to Claim 1 wherein said reference patches are formed on the photographic film strip as an ini- 
tial step of said photographic processing step. 

45 5. A method according to Claim 1 wherein step f) forms corrected density representative digital signals by multiplying 
said density representative digital signals corresponding to the photographic images by said gamma correction val- 
ues. 

6. A method according to Claim 1 wherein said gamma correction values take the form of one dimensional look-up- 
50 tables relating said density representative digital signals corresponding to the photographic images to said cor- 
rected density representative digital signals. 

7. A method according to Claim 1 wherein two reference patches are used and the calculation of said gamma correc- 
tion values is performed by determining: 

55 
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8. A method according to Claim 1 wherein three or more reference patches are used and said gamma correction val- 
ues are determined based on the regression of said density representative digital signals corresponding to said ref- 
erence patches with standard film density values. 

5 9. A method according to Claim 1 wherein the photographic film strip is positive working. 

10. A method according to Claim 1 wherein the photographic film is negative working. 

1 1 . A method according to Claim 1 wherein the photographic film strip is a color film of the type that uses R, G, and B, 
io density values of the photographic film strip to determine the R, G, and B, density values of the produced photo- 
graphic images. 

12. A method according to Claim 11 wherein three or more reference patches are used and at least one reference 
patch differs in color from the other reference patches. 

15 

1 3. A method according to Claim 1 2 wherein step f) forms corrected density representative digital signals by determin- 
ing 
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25 

and the gamma correction values of matrix M, a1 through a9, are determined based on the regression of said den- 
sity representative digital signals corresponding to said reference patches with standard film density values. 

30 14. A method for producing photographic images from a negative working photographic film strip, of the type that uses 
density values of the photographic film strip to determine the density values of the produced photographic images, 
the improvement comprising the steps of: 

a) forming at least two reference patches of differing exposure conditions onto an otherwise unexposed portion 
35 of the photographic film strip prior to photographic processing, each reference patch falling within the total 

scale of the photographic film strip; 

b) photographically processing the photographic film strip to form densities corresponding to the photographic 
images and said reference patches; 

c) scanning said processed photographic film strip to form density representative digital signals corresponding 
4o to the photographic images, said reference patches, and an unexposed region of the photographic film strip; 

d) obtaining standard film density values representative of the photographic film strip; 

e) calculating gamma correction values from said density representative digital signals corresponding to said 
reference patches and said standard film density values; 

f) utilizing said calculated gamma correction values, said density representative digital signals corresponding 
45 to the photographic images, said density representative digital signals corresponding to the unexposed region 

of the photographic film strip, and said standard film density values to form corrected density representative 
digital signals; and 

g) utilizing said corrected density representative digital signals to produce photographic images from the 
images recorded on the photographic film strip. 

50 

15. A method according to Claim 14 wherein two reference patches are used and the calculation of said gamma cor- 
rection values is performed by determining: 

1 6. A method according to Claim 14 wherein three or more reference patches are used and said gamma correction val- 
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ues are determined based on the regression of said density representative digital signals corresponding to said ref- 
erence patches with standard film density values. 

1 7. A method according to Claim 1 4 wherein step f ) forms corrected density representative digital signals by determin- 
ing: 



18. A method according to Claim 14 wherein said gamma correction values, said density representative digital signals 
corresponding to the unexposed region of the photographic film strip, and said standard film density values take the 
form of one dimensional look-up-tables relating said density representative digital signals corresponding to the 
photographic images to said corrected density representative digital signals. 

1 9. A method for producing photographic images from a negative working photographic film strip, of the type that uses 
density values of the photographic film strip to determine the density values of the produced photographic images, 
the improvement comprising the steps of: 

a) forming at least two reference patches of differing exposure conditions onto an otherwise unexposed portion 
of the photographic film strip prior to photographic processing, each reference patch falling within the total 
scale of the photographic film strip; 

b) photographically processing the photographic film strip to form densities corresponding to the photographic 
images and said reference patches: 

c) scanning said processed photographic film strip to form density representative digital signals corresponding 
to the photographic images, said reference patches, and an unexposed region of the photographic film strip; 

d) obtaining standard film density values representative of the photographic film strip; 

e) calculating gamma correction values from said density representative digital signals corresponding to said 
reference patches and said standard film density values; 

f) calculating speed correction values from said density representative digital signals corresponding to said ref- 
erence patches, density representative digital signals corresponding to said unexposed region of the photo- 
graphic film strip, and standard film density values; 

g) utilizing said calculated gamma correction values, said calculated speed correction values, and said density 
representative digital signals corresponding to the photographic images, to form corrected density representa- 
tive digital signals; and 

h) utilizing said corrected density representative digital signals toe produce photographic images from the 
images recorded on the photographic film strip. 

20. A method according to Claim 19 wherein two reference patches differing only in exposure intensity are used and 
the calculation of said gamma correction values is performed by determining: 



21 . A method according to Claim 1 9 wherein two reference patches are used and the calculation of said speed correc 
tion value(s) is performed by determining: 



22. A method according to Claim 1 9 wherein three or more reference patches are used and said gamma correction val- 
ues and said speed correction values are determined based on the regression of said density representative digital 
signals corresponding to said reference patches and said unexposed region of the photographic film strip with said 
standard film densities. 

23. A method according to Claim 1 9 wherein step g) forms corrected density representative digital signals by determin- 





ASpd D = Spd D -Spd° where Spd D = 
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ing: 

D yC = D*Ay D -ASpd D ^ 

24. A method according to Claim 19 wherein said gamma correction values and speed correction values take the form 
of one dimensional look-up-tables relating said density representative digital signals corresponding to the photo- 
graphic images to said corrected density representative digital signals. 

25. A method for producing photographic images from a negative working photographic film strip, of the type that uses 
R, G, and B, density values of the photographic film strip to determine the R, G, and B, density values of the pro- 
duced photographic images, the improvement comprising the steps of: 

a) forming at least three reference patches of differing exposure conditions onto an otherwise unexposed por- 
tion of the photographic film strip prior to photographic processing, each reference patch falling within the total 
scale of the photographic film strip; 

b) photographically processing the photographic film strip to form densities corresponding to the photographic 
images and said reference patches; 

c) scanning said processed photographic film strip to form R, G, and B, density representative digital signals 
corresponding to the photographic images, said reference patches, and an unexposed region of the photo- 
graphic film strip; 

d) obtaining standard film R, G, and B, density values representative of the photographic film strip; 

e) calculating a gamma correction matrix from said R, G, and B, density representative digital signals corre- 
sponding to said reference patches and said standard film R, G, and B, density values; 

f) calculating R, G, and B, speed correction values from said R, G, and B, density representative digital signals 
corresponding to said reference patches, R, G, and B, density representative digital signals corresponding to 
said unexposed region of the photographic film strip, and said standard film R. G. and B, density values; 

g) utilizing said calculated gamma correction matrix, said R, G, and B, density representative digital signals 
corresponding to the photographic images, said R, G, and B, density representative digital signals correspond- 
ing to the unexposed region of the photographic film strip, and said standard film R, G, and B, density values 
to form corrected R, G, and B, density representative digital signals; and 

h) forming R, G, and B, channel independent density representative digital signals from said corrected R, G, 
and B, density representative digital signals; 

i) forming R, G, and B, log exposure representative digital signals from said R, G, and B, channel independent 
density representative digital signals; 

j) utilizing said R, G, and B, speed correction values and said R, G, and B, log exposure representative digital 
signals to form corrected R, G, and B, log exposure representative digital signals; and 
k) utilizing said corrected R, G, and B, log exposure representative digital signals to produce photographic 
images from the images recorded on the photographic film strip. 

26. A method according to Claim 25 wherein step j) forms corrected R, G, and B, log exposure representative digital 
signals by subtracting said R, G, and B speed correction values from said R, G, and B log exposure representative 
digital signals. 

27. A method according to Claim 25 wherein steps e) through j) are implemented in a 3D look-up-table. 
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(54) Digital process sensitivity correction 

(57) A method for producing photographic images 
from a photographic film strip (10), of the type that uses 
density values of the photographic film strip to deter- 
mine the density values of the produced photographic 
images, comprising the steps of: 

a) forming at least two reference patches (1 4) of dif- 
fering exposure conditions onto an otherwise unex- 
posed portion of the photographic film strip prior to 
photographic processing, each reference patch fall- 
ing within the total scale of the photographic film 
strip; 

b) photographically processing the photographic 
film strip to form densities corresponding to the 
photographic images and said reference patches; 

c) scanning said processed photographic film strip 
to form density representative digital signals for the 
photographic images (12) and said reference 
patches (14); 

d) obtaining standard film density values represent- 
ative of the photographic film strip; 

e) calculating gamma correction values from said 
density representative digital signals corresponding 
to said reference patches and said standard film 
density values; 

f) utilizing said calculated gamma correction values 
and said density representative digital signals cor- 
responding to the photographic images to form cor- 
rected density representative digital signals; and 

g) utilizing said corrected density representative 
digital signals to produce photographic images from 



the images recorded on the photographic film strip. 
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